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Abstract 

Effective teaching perfonnance is a crucial factor contributing to students’ learning 
improvement. Students’ ratings of teachers at the end of each semester can indirectly 
provide valuable information about teachers’ performance. This paper selects classes 
of freshmen students taking a course of English in a university of Taiwan from the 
academic year 2004 to 2006 as the research object. We adopt the data envelopment 
analysis, a reliable and robust evaluation method, to identify the relative efficiencies 
of each class. The calculation is performed in two phases. In phase 1, all the classes 
are in the same pool. The results of numerical analysis in phase 1 are used to clarify 
whether the existing teaching methods can achieve the desired results and what are 
the improved methods. Based on the calculation of phase 1, we segment all the 
classes into 2 groups according to their contribution of output indicators in calculating 
efficiency values. The empirical results are expected to identify more objective 
classes and to reveal that the evaluated classes refer to different efficient classes in 
different phases and their ranking order changes accordingly. This method can help to 
provide some concrete and practical teaching strategies for the inefficient classes. 

Keywords: data envelopment analysis; English courses; teaching performance; 
segmentation. 
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Introduction 

English remains an indispensable communication tool and a valuable skill for the 
English as second language learners who expect to enter the job market. In Asian non- 
Latin speaking countries such as Taiwan, Japan, China, and South Korea, students 
often struggle to have a good command of the English language in their professional 
life. Effective teaching performance is a crucial factor contributing to students’ 
learning improvement. Students’ ratings of teachers at the end of each semester can 
indirectly provide valuable infonnation about teachers’ performance. Key 
performance indicators (KPIs) are measures of accomplishment. Without the 
evaluation of performance based on key factors and indicators, there will be no 
permanent change and improvement in the enhancement of the quality of educational 
institutions (Azma, 2010). 

This paper randomly selects 25 classes (among around 250 classes) of freshmen 
students taking a course of English in a university of Taiwan of the academic year 
2004 to 2006 as the research object. We adopt the data envelopment analysis (DEA), 
a reliable and robust evaluation method, to identify the relative efficiencies of each 
class. This study focuses on four indicators as an example: two inputs (the course is 
clearly explained and can easily be assimilated and good communication channels 
between the teacher and the students) and two outputs (students’ satisfaction about 
their grades and students’ learning performance). These four representative indicators 
were selected among a total of 10 and have passed the Pearson correlation coefficient 
test. The calculation is performed in two phases. In phase 1, all the classes are in the 
same pool. The results of numerical analysis in phase 1 are used to clarify whether the 
existing teaching methods can achieve the desired results and what are the improved 
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methods. Based on the calculation of phase 1, we segment all the classes into 2 groups 
according to their contribution of output indicators in calculating efficiency values. 
The empirical results are expected to identify more objective classes and to reveal that 
the evaluated classes refer to different efficient classes in different phases and their 
ranking order changes accordingly. 

The remainder of this paper is organized as follows: section 2 (literature review) 
presents some academic studies in relation with our research. Section 3 (methodology 
and selected evaluated indicators) introduces the DEA model, explains the method 
used, presents the data and the important indicators discussed in this paper. Section 4 
(empirical results and suggestions) presents the obtained numerical results based on 
the empirical data which include the efficiency analysis and the segmentation 
analysis. Section 5 draws the conclusions, limitations and directions of future studies. 

Literature review 

According to Sanders & Horn (1998), students with comparable achievement levels in 
second grade had different outcomes in fifth grade because of a large number of 
variables such as socio-economic status, school, and class size. But the variable which 
had the greatest impact on student achievement was teacher quality. Because teacher 
performance is so essential to student accomplishment, many studies have tried to 
define key perfonnance indicators (KPIs) in order to assess and to improve teacher 
performance. KPIs are tools used by individuals and organizations to track progress 
and success. Milken (2000) developed a teacher perfonnance based accountability 
system in public schools in Arizona using indicators such as teacher skills, 
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knowledge, and responsibilities, classroom-level student achievement gains, and 
school-wide achievement gains. 

In 2002, the National Committee for the Evaluation of the University System 
(CNVSU) organized in Italy an expert team to devise a teaching evaluation 
questionnaire, the Short Fonn Questionnaire (SFQ), to ensure homogenous evaluation 
in all Italian universities (Iezzi, 2005). The SFQ defined several indicators, such as 
the structure of the degree, the organization of the course, didactic activity and study, 
infrastructures, and interest and satisfaction. 

Foveland and Foveland (2003) discussed a large number of suggestions for improving 
the ratings of 10 factors identified as significant such as (in order of priority) 
knowledge of the subject, communication skills/ability, enthusiasm for the subject, 
encouragement of student participation, rapport with students, fairness in grading, 
timeliness in providing feedback, organization of class, adequacy of text-book and 
other learning materials, and instructor's preparation for class. 

Wolf et al. (2004) described the weaknesses (poor delivery of course contents, being 
disorganized, inaccessible, and displaying weak teaching skills) and the qualities 
(being a knowledgeable and strategic teacher, creating a positive learning 
environment, demonstrating professionalism, demonstrating positive personal traits, 
and displaying scholarly traits) in faculty teaching perfonnance. 

Johnes (2006) applied Data envelopment analysis (DEA) to measure the performance 
of Higher Education institutions (HEIs). This study uses an output-oriented approach 
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and indicators such as score based on best 3 A levels or equivalent, gender, school, % 
of graduates who are female, % of graduates who did not attend an independent 
school, and pass/other. Johnes (2006) shows that measures of the efficiency of 
departments derived from individuals’ efficiencies are much more highly correlated 
with department level efficiency scores. 

Martin (2006) applied DEA methodology and selected indicators concerning both the 
teaching and the research activity of the departments of the University of Zaragoza 
(Spain) in order to assess their performance. The inputs selected were human 
resources, financial resources and material resources; the outputs were credits 
registered x experimental coefficient, Ph.D. credits offered, Ph.D. completions, 
annual research incomes, and scientific production index. 

McGowan & Graham (2009) highlighted four indicators contributing most to 
improved teaching: active/practical learning, teacher/student interactions, clear 
expectations/learning outcomes, and faculty preparation. 

Wu and Li (2009) constructed a performance measure indicators system for higher 
education using four perspectives: financial, customer, internal process, and learning 
& growth. Zhou and Wang (2009) applied DEA to analyze the efficiency of 16 
universities in China. Their performance indicators are teachers as labor power index, 
financial power, physical power, number of graduates, and scientific research. 

Montoneri et al. (2011) applied DEA to assess the performance of English writing 
courses in a university of Taiwan and selected four indicators: preparation of teaching 
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contents, teaching skills, fair grading, and students’ learning perfonnance. They 
showed that the evaluated classes may refer to different facet reference sets according 
to their actual values located in lower or higher ranges. As a result, inefficient 
evaluated classes may compare themselves with efficient evaluated classes in their 
range and make improvement little by little. 

Various studies have been conducted on the KPIs of evaluation, but there is little 
consensus concerning the choice of indicators to assess the performance of teachers 
and educational institutions. The main purpose of this research is not to decide which 
indicators are the most suitable, but to find the more important indicators and help to 
formulate improvement suggestions for educators. 

Methodology and selected evaluated indicators 

The efficiency assessment is often conducted by DEA which can measure the relative 
efficiency of educational institutions from commonly available performance 
indicators. This paper uses DEA to investigate the indicators contributing to teaching 
performance in a university of Taiwan. We use students’ ratings of teachers 
(questionnaires filled at the end of each semester) about the course they follow. 

Origins and application of DEA 

The starting point of DEA is attributed to Farrell’s seminal 1957 paper (Forsund and 
Sarafoglou, 2002). In his study, Farrell introduced his concept of efficiency 
measurement. This concept became more popular after Charnes, Cooper, and Rhodes 
(1978) developed Farrell’s efficiency measurement concept. Their method, the so- 
called “Charnes-Cooper-Rhodes (CCR) model” or “CCR model” includes the 
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function and concept of benchmarking and introduced the concept of multiple inputs 
and multiple outputs. The CCR (ratio) model is nowadays the most widely used DEA 
model. If the efficiency value of the CCR model equals 1, the evaluated unit is 
efficient (of optimal perfonnance); if the efficiency value is less than 1, the evaluated 
unit needs some improvement (Lin et ah, 2009; Lee, 2009). 

DEA is a reliable and robust evaluation method which has notably been applied to 
assess the efficiency of educational institutions (Ahn et ah, 1989; Johnes & Johnes, 
1993; Ng & Li, 2000; Abbott and Doucouliagos, 2003; Johnes, 2006; Garcia-Aracil 
and Palomares-Montero, 2008). It has also been applied more recently to assess the 
performance of various courses (Mathematics and Science in Ismail, 2009; English 
writing courses in Montoneri et ah, 2011). 


DEA model 

This paper adopts the evaluating method—DEA to perform the efficiency evaluations 
of a course of English for freshmen from various departments. We investigate the 
relative efficiency of decision-making units (DMUs), that is, the evaluated classes. 
The DMUs’ relative efficiency values are calculated under an output oriented CCR 
model. According to Montoneri et al. (2011), minimizing input indicators in order to 
obtain an efficiency value equal to 1 can mislead educators. Therefore, the output 
oriented model is more suitable than an input oriented model, notably because it can 
emphasize on how much the insufficiency of the output perfonnance is under the 
current input resources without additional input efforts. 
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Data selecting—input and output indicators 
The data source 

The study case is a private university established in 1956 in Taiwan. There are 
approximately 11,000 undergraduate students in the university. The data comes from 
the university’s online student rating system, which provides student feedback to 
professors at the end of each semester. Students are required to fill out the 
questionnaires. 

The characteristics of the research object are as follows: 

1. Freshmen students in a university of Taiwan from the academic year 2004 to 
2006. 

2. The classes are randomly selected from around 250 classes among 21 
departments. English majors from the Department of English Language, Literature 
and Linguistics are not included. 

3. English is a required course for freshmen for all the departments of the studied 
university. All the classes follow a similar course to meet the homogeneity of the 
evaluated object. 

4. The English course is a 2-credit course (2 hours/week). Each teacher can choose 
the text-book of his/her choice. Most of the teachers propose group discussions 
and role plays during the class. 

5. A total of 25 classes taught by full-time and part-time teachers are selected as the 
decision making units (DMUs), that is, the evaluated units. They are named from 
D1 to D25. 

6. Among the selected departments for this research: Department of Mass 
Communication, Department of Law, Department of Chinese Literature, 
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Department of Social Work and Child Welfare, Department of Applied 
Chemistry, Department of International Business, Department of Accounting, 
Department of Tourism, Department of Computer Science and Information 
Engineering, and Department of Finance. 

The characteristics of the data source are as follows: 

1. The data are based on questionnaires (10 questions) filled out by the students at 
the end of each semester for each class. Each question is rated from 1 (very 
unsatisfied) to 5 (very satisfied) by the students. 

2. This paper aims at providing a method to identify the indicators contributing to 
teaching performance; this method can be applicable to different kinds of data and 
various types of courses. 

3. To ensure the reliability of the questionnaires, at least half of the class must 
answer seriously. If a student gives ratings too different from the rest of the class, 
he/she is excluded. 

4. The average scores of each question undergo a correlation analysis to test the 
reliability of the ratings and to find representative indicators in this study. 

5. The data concerning the selected indicators is fed in the software Frontier Analyst 
to calculate the performance values of each evaluated class. 

After the rule of thumb, the number of evaluated units is suggested to be two 
times or even four times the number of indicators. Based on the questionnaires, four 
indicators are appropriate in the current research. The indicators selected for the 
evaluation model are abbreviated by II, 12 and 01, 02 respectively and presented. 
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Input indicators 

11. Course clearly explained and easily assimilated: it refers to the degree 
of teachers’ professional knowledge for the preparation of the course. 

12. Good communication channels between the teacher and the students: it 
indicates whether the teacher can actively answer students’ queries and clear 
their doubts. It signifies whether teachers can adapt to students’ learning habits 
and their learning channels. This indicator may increase students’ learning 
interest and learning motivation. 

Output indicators 

01. Students’ satisfaction about their grades: students fill the questionnaire 
before the end of the semester; therefore this indicator should not represent 
students’ immediate response to one particular grade, but a general appreciation 
of the fairness of grading during the whole semester. 

02. Students’ learning performance: it indicates students’ self-recognition 
of learning performance after receiving a period of language training. This 
indicator relates teacher quality to student achievement. 

Correlation analysis of input and output indicators 

As mentioned in Lin et al. (2009), the Pearson correlation coefficient test is often used 
to verify whether the correlation is high among variables. A closer relation between 
two variables means that their correlation coefficient is higher, while less correlated 
variables have a lower correlation coefficient. Generally speaking, a Pearson 
correlation coefficient of 0.8 or above represents a very high correlation; a value of 
0.6 to 0.8 represents a high correlation; a value of 0.2 to 0.4 represents a low 
correlation; the value inferior to 0.2 represents an extremely low correlation or not 
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correlated. The correlation coefficients among the four selected indicators listed in 
Table 1 below are all above 0.8 with a significant level of 1%. This shows a very high 
degree of correlation. The principle of isotonicity is satisfied. 

Table 1. Pearson correlation coefficients between input and output indicators. 



Inputs 

11 

(Course clearly 
explained and easily 
assimilated) 

12 

(Good communication 
channels between 
teacher and students) 

01 (Students’ satisfaction about 
their grades) 

0.851* 

0.928* 

02 (Students’ 

performance) 

learning 

0.925* 

0.936* 


Notes: 1. * denotes significant levels at 1%. 


Empirical results and suggestions 

The 25 DMUs’ relative efficiency values are calculated under an output oriented CCR 
model of DEA and are conducted in two phases. In phase 1, all the 25 DMUs are in 
the same pool. The results of numerical analysis in phase 1 are used to clarify the 
relative efficiency of each DMU and the indicators’ contribution in calculating 
efficiency value. In phase 2, the 25 DMUs are segmented according to their output 
indicators’ contribution in calculating efficiency value acquired in phase 1. The 
purpose of this segmentation is to regroup DMUs of similar characteristics and to 
identify the more objective DMUs which are suitable for designing questionnaires 
concerning teaching performance evaluation. This study can provide suggestions to 
teachers about how to make a better use of limited teaching resources in order to 
increase their teaching efficiency in short tenn. 
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DMUs’ efficiency analysis in phase 1 

Table 2 lists some performance indicators of the DMUs which are ranked by 
descending order of “Efficiency value”. The DMUs with an efficiency value equal to 

1 are efficient can constitute “reference sets” which fonn efficiency frontier curves. If 
the efficiency value is less than 1, the evaluated unit is inefficient. The efficient 
DMUs are the referring standards for other inefficient DMUs. The efficiency value of 
each DMU is calculated by the distance of their locations to the efficiency frontier 
curves. The results show that the average efficiency of all the DMUs is 0.968; that of 
the inefficient ones is 0.962. The efficiencies of the DMUs D15, D20, D19 and D16 
in phase 1 show the best perfonnance with value of 1. That is, they are all on the 
efficiency frontier curves without the need of further improvement in the inputs and 
outputs. The inefficient DMUs can improve their efficiency by referring to the 
efficient DMUs of their reference set. 

The input and output indicators’ contribution in calculating DMUs’ relative efficiency 
values gives infonnation about their importance. As a result, the values listed in Table 

2 allow us to identify which inputs and outputs have been used or not in detennining 
efficiency. For example, the contributions of 01 (students’ satisfaction about their 
grades) and 02 (students’ learning performance) in calculating D15’s relative 
efficiency values are 71.7% and 28.3%, respectively; and the contribution values of II 
(course clearly explained and easily assimilated) and 12 (good communication 
channels between the teacher and the students) are 0% and 100%, respectively. This 
means that for D15, students’ satisfaction about their grades is almost 3 times more 
important than students’ learning performance in calculating its relative teaching 
efficiency, which is only influenced by the input indicator 12; that is, the good 
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communication channels between the teacher and the students. The input and output 
indicators’ average contributions for all the DMUs reveal that 02 and 12 are the major 
indicators in the efficiency evaluation of studied empirical example, with 61.3% and 
80.9%, respectively. That is, generally speaking, the students’ learning performance is 
the major output indicator and the good communication channels between the teacher 
and the students is the major input indicator. 

Suggestions. In order to improve teaching perfonnance, teachers of inefficient DMUs 
should emulate the efficient DMUs of their reference set and focus on enhancing the 
communication channels, adapt to students’ learning habits and their learning 
channels, such as language learning websites, learning software, online courses, 
mobile phones, Twitter, Facebook, blogs, etc., in order to give them enough learning 
support during and outside the class. Consequently, students’ learning motivation and 
performance will be increased accordingly. 
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Table 2 Relative performance indicators of DMUs in phase 1 


DMU name 

Efficienc 
y value 

Ran 

k 

Reference 

set 

Contribution in calculating efficiency 
value (%) 

Ol 02 11 12 

D20 

1.000 

1 

D20 

26.1 

73.9 

0.0 

100.0 

D16 

1.000 

1 

D16 

95.7 

4.3 

81.6 

18.4 

D19 

1.000 

1 

D19 

74.5 

25.5 

0.0 

100.0 

D15 

1.000 

1 

D15 

71.7 

28.3 

0.0 

100.0 

D22 

0.990 

5 

D20 

0.0 

100.0 

0.0 

100.0 

D24 

0.986 

6 

D15, D19 

72.3 

27.7 

0.0 

100.0 

D13 

0.985 

7 

D15, D20 

0.0 

100.0 

12.5 

87.5 

D7 

0.980 

8 

D15, D20 

0.0 

100.0 

12.1 

87.9 

D17 

0.978 

9 

D15, D19 

72.3 

27.7 

0.0 

100.0 

D1 

0.975 

10 

D15, D20 

0.0 

100.0 

12.6 

87.4 

D25 

0.969 

11 

D15, D19 

72.7 

27.3 

0.0 

100.0 

D21 

0.967 

12 

D15, D20 

0.0 

100.0 

12.3 

87.7 

DIO 

0.963 

13 

D15, D20 

26.4 

73.6 

0.0 

100.0 

D9 

0.960 

14 

D20 

0.0 

100.0 

0.0 

100.0 

D4 

0.959 

15 

D15, D20 

0.0 

100.0 

12.5 

87.5 

D14 

0.959 

16 

D15, D20 

0.0 

100.0 

12.2 

87.8 

D5 

0.957 

17 

D15, D19 

72.5 

27.5 

0.0 

100.0 

D3 

0.957 

18 

D15, D20 

0.0 

100.0 

12.4 

87.6 

D12 

0.956 

19 

D15, D19 

72.1 

27.9 

0.0 

100.0 

D2 

0.956 

20 

D15, D20 

0.0 

100.0 

12.3 

87.7 

D23 

0.950 

21 

D15, D16, 

96.0 

4.0 

82.5 

17.5 

Dll 

0.950 

22 

D19 

71.7 

28.3 

0.0 

100.0 

D18 

0.947 

23 

D15, D19 

0.0 

100.0 

12.6 

87.4 

D8 

0.943 

24 

D15, D20 

72.2 

27.8 

0.0 

100.0 

D6 

0.920 

25 

D15, D19 

71.9 

28.1 

0.0 

100.0 




D15, D19 





Average of all „ _ 

the DMUs °' %8 



38.7 

61.3 

11.0 

89.0 

Average of the 

inefficient 0.962 

DMUs 



33.3 

66.7 

9.2 

90.8 

Note: 01 is 

; “students’ 

satisfaction about their grades 

”; 02 is “ 

students’ learning 


performance”; II is “course clearly explained and easily assimilated”; 12 is “good 
communication channels between the teacher and the students”. 

DMUs’ efficiency analysis in phase 2 — Segmentation of DMUs by output 

indicators’ contribution 


Based on the calculation of phase 1, we segment all the DMUs into 2 groups 
according to their output indicators’ contribution in calculating the relative efficiency. 
The DMUs with 01’s contribution superior to 50% are classified as the group 01 
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which contains 12 DMUs: D16, D19, D15, D24, D17, D25, D5, D12, D23, Dll, D8 
and D6. The DMUs with 02’s contribution superior to 50% are classified as the group 
02 which contains 13 DMUs: D20, D7, DIO, D13, D22, Dl, D21, D14, D2, D4, D3, 
D9 and D18. For example, D16 belonging to group 01 has Ol’s contribution (95.7%) 
superior to that of 02 (4.3%). 

In phase 2, the calculation of each DMU’s relative efficiency is separately conducted 
in the two groups and the efficient frontier curves are reconstituted in the two 
different segmented groups. Table 3 includes each DMU’s relative efficiency, rank 
order and output indicators’ contribution in calculating relative efficiency in phase 1 
and phase 2. The results reveal that: 

One new efficient DMU appears in phase 2. The 3 efficient DMUs (D16, D19, and 
D15) in phase 1 are still efficient in phase 2; but one more DMU (D7) becomes 
efficient in phase 2 and is located in the segmented group 02. Because the 
segmentation according to output indicators’ contribution makes the new 
reconstituted frontier curves in group 01 now closer to the 01 value and in group 02 
now closer to the 02 value, this results in a new efficient DMU appearing in group 
02 in phase 2. 

The DMUs of group 01 are more influenced by 01 in phase 2 than in phase 1; the 
DMUs of group 02 are more influenced by 02 in phase 2 than in phase 1. This 
phenomenon can be proved by the slightly increase or by the same efficiency value in 
phase 2 than in phase 1. 
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Inefficient DMUs refer to different efficient DMUs in different phases. Because 3 
of the 4 efficient DMUs in phase 1 now belong to group 01, one other efficient DMU 
belongs to group 02. This implies that after the segmentation, the efficient frontier 
curves are recalculated and the efficient DMUs can probably be changed; some of the 
inefficient DMUs in group 01 originally referring to the efficient DMUs which are 
now located in group 02 have to refer to different efficient DMUs, because they are 
in different pools. For example, the two inefficient DMUs of group 02, D1 and D21, 
originally referred to the efficient DMUs D15 and D20 in phase 1; because D15 is 
located in group 01 in phase 2, they refer to the efficient DMUs D20 and D7 instead. 

Ranking order changes in different phases. In group 01, the 12 DMUs’ ranking 
order in phase 1 is the same as that in phase 2; however, in group 02, the 13 DMUs’ 
ranking order in phase 1 is different from that in phase 2. For example, D22, Dl, 
D21, D4, and D9 have higher rank in phase 1 than in phase 2; and D7, DIO, D14 and 
D2 have lower ra nk in phase 1 than in phase 2. Only 4 DMUs in group 02 keep the 
same ranking order as in phase 1. There is one new efficient DMU in group 02 
because the new frontier curves are closer to 02 in phase 2. Group 02’s efficiency 
values are equivalent or slightly higher in phase 2 than in phase 1. 

More objective DMUs appear. In group 02, the major indicator of DMUs D7, DIO, 
D4 and D18 changes from 02 to 01. It implies that these four DMUs are more 
influenced by the presence of other DMUs and are less objective concerning the 
result of teaching efficiency. As for the DMUs in group 01, their major indicator is 
still 01. Therefore, except D7, DIO, D4 and D18, all the DMUs of group 01 and 02 
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are more suitable for designing questionnaires concerning teaching performance 
evaluation. 


Table 3. DMUs’ relative efficiency ranks and output indicators’ contribution in two 
phases 





Group Ol 






Group 02 



Unit 

name 

Rank in 
phase 

Relative 
efficiency in 
phase 

Contribution 
of Ol in 
phase 

Unit 

nam 

e 

Rank 

in 

phase 

Relative 
efficiency in 
phase 

Contributio 

n 

of 02 in 
phase 

1* 

2 

1 

2 

1 

2 

1* 

* 

2 

1 

2 

1 

2 

D16 

1 

1 

1.000 

1.000 

95.7 

100.0 

D20 

1 

1 

1.000 

1.000 

73.9 

100 

D19 

1 

1 

1.000 

1.000 

74.5 

100.0 

D7 

4 

1 

0.980 

1.000 

100.0 

0 

D15 

1 

1 

1.000 

1.000 

71.7 

71.7 

D10 

7 

3 

0.963 

0.991 

73.6 

0 

D24 

4 

4 

0.986 

0.986 

72.3 

72.3 

D13 

3 

3 

0.985 

0.991 

100.0 

100 

D17 

5 

5 

0.978 

0.978 

72.3 

72.3 

D22 

2 

5 

0.990 

0.990 

100.0 

100 

D25 

6 

6 

0.969 

0.969 

72.7 

72.7 

D1 

5 

6 

0.975 

0.978 

100.0 

100 

D5 

7 

7 

0.957 

0.958 

72.5 

72.5 

D21 

6 

7 

0.967 

0.978 

100.0 

100 

D12 

8 

8 

0.956 

0.956 

72.1 

72.1 

D14 

10 

8 

0.959 

0.973 

100.0 

100 

D23 

9 

9 

0.950 

0.950 

96.0 

96.0 

D2 

12 

9 

0.956 

0.967 

100.0 

100 

Dll 

10 

10 

0.950 

0.950 

71.7 

71.7 

D4 

9 

10 

0.959 

0.967 

100.0 

0 

D8 

11 

11 

0.943 

0.943 

72.2 

72.2 

D3 

11 

11 

0.957 

0.965 

100.0 

100 

D6 

12 

12 

0.920 

0.921 

71.9 

71.9 

D9 

8 

12 

0.960 

0.960 

100.0 

100 








D18 

13 

13 

0.947 

0.951 

100.0 

0 


Note: *: Group Ol’s ra nk in phase 1 means that their new rank does not consider the 
presence of group 02’s DMUs. **: Group 02’s rank in phase 1 means that their new 
rank does not consider the presence of group Ol’s DMUs. 


96 



The IAFO R journal of Education 


Volume 1 - Issue 1 - Spring 2013 


Conclusions and suggestions 

This paper applies DEA to calculate the relative efficiency values of 25 evaluated 
classes under an output oriented CCR model. The calculations are conducted in two 
phases. In phase 1, all the 25 DMUs are in the same pool. The results are used to 
clarify the relative efficiency of each DMU and the indicators’ contribution in 
calculating efficiency value. All the inefficient DMUs of group 01 (D24, D17, D25, 
D5, D12, D23, Dll, D8 and D6) are suggested to concentrate teaching effort on 
indicator 01 (students’ satisfaction about their grades) in order to increase their 
relative efficiency in short term. Teachers are suggested to announce grading criteria 
as clearly and early as possible in order to guide students and to answer their 
questions and doubts before the exams. After the exams, teachers should give a 
correction and advices to students. Students who have a bad grade sometimes give up 
and drop the class. Under these circumstances, communication channels between the 
teacher and the students should be fast and clear. Students need to feel that teachers 
care about them. In addition, teachers can offer them some help after the class or 
during the office hours. Students need to know why they failed, and more important, 
what they can do to improve their level. This will help enhance students’ learning 
motivation and increase the value of 02 (students’ learning perfonnance) at the same 
time. All the inefficient DMUs of group 02 (D17, D25, D5, D12, D23, Dll, D8 and 
D6) are suggested to concentrate teaching effort on indicator 02 in order to increase 
their relative efficiency in short term. Teachers can offer students help outside the 
class (teaching website, English comer, office hours). 

In phase 2, the 25 DMUs are segmented according to their output indicators’ 
contribution in calculating efficiency value acquired in phase 1. The purpose of this 
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segmentation is to regroup DMUs of similar characteristics and to identify the more 
objective DMUs which are suitable for designing questionnaires concerning teaching 
performance evaluation. The analysis of phase 2 shows that except D7, DIO, D4 and 
D18, all other DMUs are more suitable for designing questionnaires. It means that on 
25 DMUs, 21 can provide reliable infonnation to educators and decision-makers. The 
results may of course vary according to the year, the subject matter, the departments 
and the classes selected. 

This paper proposes a method to find out the more important evaluated indicators and 
help to formulate improvement suggestions for educators in Taiwan concerning 
English courses for freshmen. Our demonstration on how to screen primary indicators 
can be useful for further studies in other countries or fields. The results of this paper 
can serve as a model for decision-makers to design the educational policies satisfying 
the objectives of enhancing the competitiveness of educational institutions. The 
results of the study need to be interpreted in light of its limitations. DEA only gives 
efficiencies relative to the data considered. This paper offers suggestions to teachers 
on how to improve their teaching according to four selected indicators. Future studies 
could propose to analyze other indicators and conduct research on teachers’ response 
to student ratings. 
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